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ABSTRACT 



This paper presents an argument against traditional 
evaluation of students by examination and offers proposals for reform 
of the present system. Strengths and weaknesses of evaluation methods 
such as objective tests, use of the year’s work, essay examinations, 
practical examinations, and oral examinations are discussed as well 
as the need for changes in examination conditions. (HS) 
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Most universf+les possess enough my+hs, bo+h fn number and 
variety^ for the Justification of almost any type of action. 
The greatest myth of al I Is that no myths govern university 
policies. A common assumption — a gnostic pretension - Is 
that, of all socIety^s Institutions, the university Is 
devoted basical ly and fiercely to the discovery and trans- 
mission of truth. With truth as the constant goal, who could 
ever doubt that university staff could be other than perfectly 
reasonable and highly efficient? and who, apart from staff 
and students, would dare to question the annual ceremonial 
procedures for evaluating those to whom truth or knowledge Is 
being tra nsm I tted . 



Can one question a myth without enstranging those who, as the 
propagators and therefore as the victims of that myth, are 

myth? The main contention In this study 
ought to offend only the most ardent advocates of traditional 
university examinations - those who believe, and who will go 
to their graves believing, that there Is one and only one way 
to assess exposure to university education, and that way Is 
through an end-of-year three-hour unseen examination. If 
such attitudes are referred to as the endorsement of a myth It 

not to be thought that I am being selectively disparaging. 
A! I too often we forsake one myth for another. And If we were 
to jettison traditional university assessment techniques 
+ u either proving (or Intending to test the hypothesis) 

that the alternative Is an Improvement then we are Indiscern- 
ible from those who refuse to examine the alternative. 

There are, I suggested above, enough myths to Justify almost any 
type of action. If what follows Is myth I would hope that 
academics might find. Interwoven In the narrative, the 
occasional mundane observation that would Justify the effort to 
If read the text. Hopeful ly, some might come to share my 

p suspicion that there are no university disciplines that could 

not vary or Improve their assessment techniques. 




Marian Logeman 
Education Vice President 
N.2.U.S. A. 
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1 nt roduct I on 



The first paper in this series from the Research Office for the 
Study of Higher Education was on The Assessment of Stud ents — 
Formal Assignments and was written by Dr Michael Bassey on the 
basis of h I s expe ri ences In teacher training. 

For those who prefer reform to revolution this, the second paper, 
looks more at a range of possible changes In examination proced- 
ures and Is a study of changes that could be Implemented and 
what their effect might be. 

While the advantages and disadvantages of continuous assessment 
are not, therefore, explicitly covered in this paper. It ought 
to be borne In mind that continuous assessment Is posed as a 
serious alternative to examination reform. Dr Bassey's paper 
ought therefore to be treated as complementary to this one. 

Assessment by formal examination is, in a variety of forms, an 
integral part of contemporary New Zealand universities. These 
examinations, whether In the guise of objective tests, essay, 
practical or oral examinations, have been subjected to consider- 
able scrutiny over the past few years. 

This particular paper Is really a summary, hopefully with a few 
new angles, of thinking in New Zealand on examination reform and 
brings together a number of aspects of examining that are 
frequently (and perhaps misleadingly) separated In some studies. 

The New Zealand University Students Association hopes that 
university teachers will be able to profit from the study and 
that It may provide useful material for those engaged in thinking 
about (and acting on) proposals for academic reform. 

At the same time It must be clearly understood that neither the 
New Zealand University Students Association nor any of the 
constituent students^ associations are necessarily committed to 
all the viewpoints expressed In this paper. 



Lindsay G. Wright, 
Education Research Officer 
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The Need for Assessment 



1. The assessment of university students ! s an — Vrr-tegi-ol part 
of the whole process of university teaching and learning. 
This proposition, while It might be at variance with the 
views of some students, will be taken as self-evident In 
the greater part of this paper. Some con s I de rst I on 
however, might we I I be given to the alms and social func- 
tions of assessment and to the relationships between 
assessment and other aspects of the teaching process. 

2. It could be argued that the assessment of students has at 
least three distihct educational alms. First, there- 
might be value In assessing progress and attainment. Per- 
haps It Is a human characteristic that an Individual needs 
to be able to know from time to time both that he has 
Improved hl.s standards of achievement and that there are 
some *'ob ject I ve” criteria against which achievements can 
be measured. Secondly, students might be assessed for 
'diagnostic’ purposes, to reveal strengths and weaknesses, 
whether In particular areas or generally. It is possible 
that students can gain ideas of the direction In which 
their studies should go as a nocu t t of such feedback. The 
third possible aim wnnid oe that of 'prognosis’ to deter- 
mine which stu<^*»"’'s might be capable of further study. 

If an ?i<=o<»ssment technique Is to be a reliable guide In 
fhfs latter respect It ought to be able to discriminate 
fairly accurately between those who could handle the study 
at a higher level, and those who could not. It would 
thus be a recognition of the I mp rec i s I on of a ’’prognostic” 
test If the subsequent performances of students could not 
be generally predicted from a purportedly prognostic test. 

A university that claimed that Its assessment techniques 
were geared towards the three ’educational' aims referred 
to above would do well to ask to what extent the aims are 
realised, 

3. Whether any social functions of assessment should exist, 
such that their recognition by the university would entail 
certain types of assessment rather than other types, is a 
question that could entertain the contemplative soul. 
Certainly It would be difficult to deny (or for that matter, 
to diminish) professional, public, and student demand for 
the certification of the academically "successful”. 
Certification, In turn, needs to be 'elated to some stan- 
dard of competence, and assessment of competence would be 

a prerequisite. This point Is argued well In paragraphs 
8—16 of the Victoria University of Wellington Report 
of the Professorial Board Commi ttee on Examining (M^rch 
T9TTT~ ^ 

4. Assessment ought, some argue, to relate to the whole 
teaching and learning process and, I n part I cu I ar , ought 
to be geared at ascertaining the extent to which the 
objectives of a course have been reached. Sometimes 
explicitly, but more often, implicitly, the argument goes 
on, university teachers do set course objectives. They 
set objectives Insofar as they devise assessment tools 
which presuppose that, by the end of the university 
teaching year, students will be able to demonstrate their 
acquisition of, for example, certain skills and knowledge. 

If the contents of examination papers are analysed in an 
attempt to deduce examiner’s objectives the results may 
show definite areas of wGakn;ess. Where this exercise 
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describe well-known materials or experiments, or to soive 
faitilllar problems. Less than 30 per cent of each paper 
required genuine thought on the part of candidates, by 
obliging them to attempt unfamiliar problems or by deman- 
ding the capacity to Interpret or evaluate data, views, or 
conclusions. While academics might spontaneously question 
the applicability of such a judgment to their own work they 
may more readily recognize the laments of their colleagues 
who claim that too many students learn for examinations 
rather than because of the merit of the subject. Such a 
claim could suggest a divergence between what the exam- 
inations test and the attainments which lecturers believe 
necessary for a genuine understanding of their subject. 

This kind of difference most probably derives from the 
lecturer’s failure to analyse his course objectives and f o 
ensure that each Is evaluated. 

It should be clear by now that. the word "objectives" Is not 
being used here as a synonym for the "aim of education" or 
the "role of the university." The need for course 
objectives transcends the more speculative exercise of de- 
bating the respective merits of utilitarian or liberal 
education. For, whether one be I I eves that the university 
should study and teach those things which are useful to 
society as a whole, or whether one adopts Cardinal Newmans 
oft-quoted and appealingly vague comment that "Liberal 
education ;^iakes not the Christian, not the Catholic, but 
the gentleman," there still remains a need -to be concerned 
with the less exalted details of pedagogical method. 

If then, we are not examining the long-term alms of 
university education, nor are we referring to the long- 
term alms of specific academic courses. These latter 
alms are certainly relevant to the whole teaching process 
for no academic would willingly recommend degree 
certification to someone who had not mastered the relevant 
skills and attitudes. Such long-term alms are In fact 
decided by academics on professional, social and 
philosophical grounds and provide a framework for the 
definition of Intermediate objectives. Thus a medical 
school may quite properly say that Its long-term aim Is to 
produce good all-round general practitioners, specialists 
of a variety of types, and medical scientists and to ensure 
that certain specified or unspecified qualities of mind 
are Inculcated. More specifically a medical school 
lecturer may outline a number of alms of the "to understand 
hypog I ycaem I a" variety. A clear set of course objectives 
would provide specific statements such as,: "to list four 

principal causes of hypog I ycaem I a , to recognise the 
difference between acute and chronic cases, to describe 
the changes In the brain, to understand the mechanism, to 
list the minor causes, to differentiate between the 
lesions of acute and chronic hypog I ycaem I a . " It Is at 

this latter and more detailed level that a clear exposition 
of course objectives Is related to assessment. And, 
while such details may be taken for granted by the expert 
In the field, students and those less familiar with the 
field will probably see the advantages of having ob- 
jectives spelled out in this way. 

Course objectives, spelled out by themselves, do lend 
themselves to rote learning and should be, some may well 
argue> moderated by less mundane objectives. The good 
university iecfurer could spell out to stu dents. In 
language suited to his ow n discipline, that ihe cou rs e 
objectives Include a variety of objectives in the 
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cognitive and affec+lve areas. The cognitive continuum- 
while It may start with the recall and recognition of 
knowledge, could Include compre hen s I on , application of 
Information, analysis, synthesis, and evaluation. On the 
affective side most university lecturers will recognise 
their duty to try to develop In students an inner Incen- 
^ learn (motivation), an active response to stimulls 

SO That they cover the assigned work voluntarily and with 
personal satisfaction, and a value such as developing a 
continuing determination to speak and write effectively, 
an appetite for what Is good In literature, or the wish to 
achieve accurate and well developed argument in writing a 
report. In addition the u n I vers I ty teacher should have 
as objectives that students sh ou Id be able to organise 
their values Into an Internally consistent system and that, 
therefore, the students may be equipped to Integrate their 
beliefs. Ideas, and attitudes Into a total ’’philosophy” or 
world view. Lecturers might well ponder the extent to 
which their assessment techniques (examinations etc) do In 
fact relate to all or any of the cognitive and affective 
objectives . 

Assessment, then, can be regarded as having educational alms, 
social functions, and a close connection with course, 
cognitive and affective objectives. While the material In 
this paper that deals directly with examinations and other 
assessment techn Iques m I ght not spell out the relationship 
between these techniques and the varieties of assessment 
procedures, the relationship should be borne constantly In 
mind. ' 
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the outset, the existence In New Zealand 
f O number of university lecturers and students who remain 

What "for +l ®^^fclency of ’'traditional examinations." 

+ purposes of this section of this study, are 

I! ^ defending It; what are the 

strengths and weaknesses In their defence; and how do 
they counter criticisms from educationists? 

illl^ie + expression "the traditional examination" 

of Students wh?nh^h®'' ‘•’hose techniques for the assessment 
students which have most of the following characteristics, 



( a ) 



(b) 



( c ) 



(d) 

(e) 



aimrte+ ° ° I"® ^ during the academic year, and 

almost certainly at the end ot the third term, 

students are obliged to attend at a scheduled place 

ll ?h?ri h respond to a one, two, 

or three hour test. 

For the end-of-year examination at least the 

’‘^obieitlve"^sho;+'"''®’^''®'' problem solving, 

Objective short-answer, or other, will not have 

been specified to the student directly. 

nulhlr ® +he student must answer a set 

number of questions, usually without recourse to 
books^or library facm+.es; and often ^r^Uras- 

Staff member of 

staff who set the examination. 



never see 
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The student may, though not Inevitably 
his written script again. 

The greater part (e.g. more than fifty per cent) of 
the marks credited to a student’s academic record 
win be based on the kind of test described above. 

By "traditional examination" then we shall be meaning both 
of"te?m'^;,!;!naM<!,nsI" moderated by results 

some students as a "grotesque memory orgy" 

Is sti iT^^ew^H^^h ‘•Tie traditional examination system 

however, by many students and staff as 
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Trad itlonal Examinations. 



Let us suppose, at the outset, the existence In New Zealand 
of a number of university lecturers and students who remain 
convinced of the efficiency of "traditional examinations. 
What, for the purposes of this section of this study, are 
they defending; why are they defending It; what are the 
strengths and weaknesses In their defence; and how do 
they counter criticisms from educationists? 

In this study the expression "the traditional examination" ^ 
will be used to refer to those techniques for the assessment 
of students which have most of the following characteristics. 

(a) At one or more times during the academic year, and 
almost certainly at the end of the third term, 
students are obliged to attend at a scheduled place 
at a predetermined time to respond to a one, two, 
or three hour test. 

(b) For the end-of-year examination at least the 
questions asked, whether essay type, problem solving, 
"objective" short-answer, or other, will not have 
been specified to the student directly. 

(c) Within a time-llmit the student must answer a set 
number of questions, usually without recourse to 
books or library facilities, and often in the pres- 
ence of an Invigilator other than the member of 
staff who set the examination. 

(d) The student may, though not inevitably, never see 
his written script again. 

(e) The greater part (e.g. more than fifty per cent) of 
the marks credited to a student’s academic record 
will be based on the kind of test described above. 

By "traditional examination" then we shall be meaning both 
the end-of-year finals and the finals moderated by results 
of term examinations. 

Described by some students as a "grotesque memory orgy" 
and a "masquerade" +he traditional examination system 

Is st I I I viewed however, by many students and staff as 
an Irritating but necessary component of academic life. 

Those who support the traditional examinations have often 
attributed to them a high educational value. Preparation 
for examinations, they argue, trains students to deal with 
new material, to discriminate between the important and the 
unimportant, to appreciate the relevance of hitherto un- 
related details, to grasp a subject as a whole and to 
combine parts Into an organic unity, to hold knowledge 
ready on demand, to think for themselves. Examinations, 
it is further argued, have an element of reward in the 
e-fijq©nt’s sense of achievement (and doubtlessly an element 
ofpunishment for failure), and an element of feedback In 
that future d I rect I ons depe nd on results. The feedback, 
some ac ad em 1 cs may say. Is valuable for hlghllQl^Ting 
weaknesses or strengths, providing an Incentive, giving 
staff an Indication of their effectiveness or Ineffect- 
iveness, checking on whether teaching objectives have 
been achieved, serving for diagnosis and selection, and 
providing a return on parental or state Investment> More 
specific defences of examinations could cover the al leged 
benefits of testing memory, coverage of the field, 
ability to relate fact and theory, ability to reason 
logically and to separate out points, and ability to write 
v^ell - to make points clearly and succin ct I y . And, 



detaMed arguments that 

purport to demonstrate the advantages of alternative 
+hf+^^K??^ techniques he can retreat Into the assertion 
that while such arguments have clear prima fade coaenrv 
when applied to other subjects the contingencies of his 
or"necessary^^^^ traditional examinations either desirable 



The defences of examinations. Including defences not cited 
above, do need to be studied carefully. While such V 

P=rt of this paps? It Isl pfsard 
afso +n examinations are frequently relevant 

Th«+ If of non-examlnatlon assessment procedures. 

1 ' assuming the necessity for some of the things 
that exams are safd to do the question Is not slmply^’»do 

Rather, one should asS 

which form of assessment does most of these things the 
most successfully. In this context It iTcertalnly 

questions of the validity and 
reliability of differing assessment techniques. 



assL?LII®+r^h''!®® validity and reliability of 

ThrJaTTd+! T° concentrate on examinations. 

The validity of an examination Is, briefly, the extent 

to which It measures what It Is, In fact.^sucpLeS to 

+ + Academics are prone to assert, though rarely 

Ino ■•■he exams they set measure 

cited In ^ara II. 

hinhf K exam advocates point to the 

ons between results In the exams they 

Ini til tests, secondary school exams, 

and the Impressions of academics themselves. These 
correlations, they might argue, show that whatever Is 
If "+ tests and other exams Is certainly 

related to what Is being assessed In traditional unlver-^ 
sity examinations. uuiver 



The problem of examination rellabl I Ity Is well known, and 
has been attributed to a number of factors. First 

P®'"^Of'"ance at any specific time may sUfT^'as a 
f f"®nta I discomfort. Secondly, 

the examination set may not be adequate for samp | I no the 
and I dates know I edge . Generally speaking, the longer the 
©xanfiFn8l"?on and "hhe n pa a + ap 
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purport to demonstrate the advantages of alternative 
assessment techniques he can retreat Into the assertion 
that while such arguments have clear prima facie cogency 
when applied to other subjects the contingencies of his 
own subject make traditional examinations either desirable 
or necessary . 

12. The defences of examinations. Including defences not cited 
above, do need to be studied carefully. While such a 
study will not form part of this paper It must be said 
that the defences of examinations are frequently relevant 
also to defences of non-exam I nat 1 on assessment procedures. 
That Is, assuming the necessity for some of the things 
that exams are said to do the question Is not simply "do 
examinations do these things?" Rather, one should ask 
which form of assessment does most of these things the 
most successful iy. In this context It Is certainly 
appropriate to discuss questions of the validity and 
reliability of differing assessment techniques. 

13. Most of the studies of the validity and reliability of 
assessment techniques seem to concsntrate on examinations. 
The validity of an examination Is, briefly, the extent 

to which It measures what It Is, In fact, supposed to 
measure. Academics are prone to assert, though rarely 
to attempt to prove, that the exams they set measure 
one , some, or all of the things that are cited In para II. 
Statistically obsessed exam advocates point to the 
highlsh correlations between results In the exams they 
set and the results In I.Q. tests, secondary school exams, 
and the Impressions of academics themselves. These 
correlations, they might argue, show that whatever Is 
being assessed In I.Q. tests and other exams Is certainly 
related to what Is being assessed I n t rad 1 1 1 ona I univei 
sity examinations. 

14. The problem of examination reliability Is well known, and 
has been attributed to a number of factors. First , 
student performance at any specific time may suffer as a 
result of physical or mental discomfort. Second I y , 

the examination set may not be adequate for samp I I ng the 
candidates knowledge. Generally speaking, the longer the 
examination and the greater the number of questions to 
be answered, the more reliable will be the score. One 
usually needs, according to some authorities, at least 
four 2- hour papers for the re I lability coefficient to 
reach 0.90 <l) This estimate of course applies to the 
traditional examination system. Thirdly , there may be 
Inconsistencies In standards of marking adopted by 
different examiners. If a grade of, say First Class or 
"A" means the grade obtained by 10 per cent of the 
candidates In one department or university, and the grade 
obtained by 5 per cent of the candidates In another 
department, then either the same grade means different 
things to different departments or the quality of stu- 
dents In the departments varies greatly. Fou rth I y , 

there may often be different dpThlons among examVriers 
about the relative value of students’ answers. Most 
academics will be well aware of the results of experi- 
ments In which the same scripts have been assessed by a 



Lovell, K. "Examinations and Marking," 
University Teaching In Transition , Oliver and 
Boyd, I 968, p 137. 
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number of Independent people and the resulting marks have 
varied quite considerably. It we put reliability In Its 
statistical context we find that at a high 0.9 re liability, 
a remarking would give 68. per cent of the students no more 
than 3 marks out of 100 either way. In 28 per cent marks 
would vary between 3 and '6 either way, and In of the 
cases they will vary by more than 6 marks. At 0.8 relia- 
bility 68% will vary by 4 marks, 28% by between 4 and 8, 
and In 4% of the cases by more than 8 marks. 

Some writings on examinations refer to a problem known as 
examination anxiety. While some degree of anxiety would 
be normal for most students who face examinations there 
are clear documented cases of examination stress that 
amount to panic and phobic anxiety. For siich students 
examinations may represent not a circumscribed and po- 
tentially manageable chaltange, but a n ove rwhe I m I ng threat 
and a potential failure to the total person. The exist- 
ence of very smal 1 numbers of students suffering from 
examination phobia may j u st I f I a b 1 y be relevant to the 
operations of s tu de nt hea I th se rv I ce s bu t does not entail 
the conclusion that exam I nat I ons shou I d be abo l ished . 

Such anxieties are, we are told by student counsel tors, 
capable often of being reduced to manageable proportions. 



number of Independent people and the resulting marks have 
varied quite considerably. It we put reliability In Its 
statistical context v;e find that at a high 0.9 reliability, 
a remarking would give 68 per cent of the students no more 
than 3 marks out of 100 either way, in 28 per cent marks 
would vary between 3 and 6 either way, and In 4? of the 
cases they will vary by more than 6 marks. At 0.8 relia- 
bility 68^5 will vary by 4 marks, 28^ by between 4 and 8, 
and in 4? of the cases by more than 8 marks. 

Some writings on examinations refer to a problem known as 
examination anxiety. While some degree of anxiety would 
be normal for most students who face examinations there 
are clear documented cases of examination stress that 
amount to panic and phobic anxiety. For such students 
examinations may represent not a cl rcumscrl bed a nd po- 
tentially manageable challenge, but an overwhelming threat 
and a potential fal lure to the total person. The exist- 
ence of very small numbers of students suffering from 
exam Inatlon phobia may justifiably be rel ev ant to the 
operations of student hea I th services but doss not entail 
the conclusion that examinations should be abolished. 

Such anxieties are, we are told by student counsellors, 
capable often of being reduced to manageable proportions. 

( I ) 

It would be difficult In the matter of assertion and 
counter assertion to say that evidence to hand, provides 
a sound Justification either for or against the retention 
of the end-of-year examination. Nonetheless, the relia- 
bility of traditional examinations Is h I g h I y su spect (In 
spite of the protestations of exam advocates); It Is 
doubtful that course objectives are measured well by 
examinations currently set; and given a clear statement of 
course, cognitive and affective objectives It Is likely 
that alternative assessment procedures might often be 
preferable. There Is, It seems., little to counter, and 
much to support the p ropos 1 1 1 on tha t traditional examin- 
ations serve |1 Ittle purpose, serve that purpose poorly, 
and could well be abolished. 



(I) Jon Frederick. "The Management of Students exper- 
iencing acute exam I nat Ibn anx i ety . " Pape r to 
Conference of ANZSHA 1970. 
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+^=wT+f course, those who admit the limitations of 

rad 1 1 1 ona I exam I nat I ons and who believe that the solution 
is not to abolish examinations but to Improve them. Of 
K? Improvements proposed we shall look at a few 

which have been t r I ed at some u n I ve rs I t y Institution and 

retention of a II of the best 

(and possibly many of the worst) features of traditional 
exam i nations. 



Objective tests 



+ largely as a reaction to exam- 

ination unreliability, are so denoted because of their 
scoring procedure. Advocates of "objective tests" mav 
argue that they yield objective data; are reliable Inso- 

closely similar 

results; ^ d I scr I m I nate more accurately the finer shades 
of knowledge between candidates; eliminate the advantage 
Sf + are more easi ly tested for 

gfve prompt, detailed and descriptive 
reedback born to the examiner and the examinee. 



Writing questions for an objective test Is a creative 
■ask, and a demanding one. The work Is slow - a competeni 
exam writer may do well to construct between five and^ten 
good Items per day, Questions must be unambiguous, 
a te mat I ve s must be p I au s I bie , the t terns mu st e I f c 1 1 
responses that wl I I I nd I cate t he I evel of a student’s 
understanding or knowledge. Several types of objective 
testscan be used : ■ 



Comp let I oh or Short Answer I terns : 



Where, ^stude^ to supply rather than select 

a re sppnse . This. format I s probably most often u sed 
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There are, of course, those who admit the limitations of 
traditional examinations and who believe that the solution 
Is not to abolish examinations but to Improve them. Of 
the variety of Improvements proposed we shall look at a f®w 
which have been tried at some university Institution and 
which are consistent with the retention of all of the best 
(and possibly many of the worst) features of traditional 
exam I na 1 1 on s . 

Objective tests 

Objective tests, developed largely as a reaction to exam- 
ination unreliability, are so denoted because of their 
scoring procedure. Advocates of "objective tests" may 
argue that they yield objective data; are reliable Inso- 
far as a test readm I n I strat I on will yield closely similar 
results; discriminate more accurately the finer shades 
of knowledge between candidates; eliminate the advantage 
gained by the speedy writer; are more easily tested for 
validity; arid can give prompt, detailed and descriptive 
feedback both to the examiner and the examinee- 

Writing questions for an objective test Is a creative 
task, and a demanding one. The work Is slow - a competent 
exam writer may do well to construct between five and ten 
good Items per day. Questions must be unambiguous, 
alternatives must be plausible, the Items must elicit 
responses that will Indicate the level of a student’s 
understanding or knowledge. Several types, of objective 
tests can be used: 

( a ) Completion or Short Answer Items : 

Where a student Is asked to supply rather than select 
a re sp on se , This format Is probably most often used 
for computation problems where students are required 
to generate specific solutions. It is also useful 
In assessing the students' knowledge of "barebones" 
factual material. Short Answer techniques are 
probably best used where the Intent Is to test 
Information recall, where computation Is required, 
or where a recognition question would make an answer 
obvious. 

( b ) Recognition and selection Items : 

Where a student Is asked to make appropriate dis- 
criminations. Wh I. le th I s format deni es to students 
the latitude to redefine c problem, to offer par- 
tially correct answers, or to Introduce Irrelevancy 
It has the d I sadvantage that recbgni s I ng a right 
from 3 wrong answer requ I res I ess thorough learning 
than recalling specific Information. 

( c ) True-False Items : 

A format relied on by lecturers seeking an easily 
•constructed test. Few statements however, are 
unquestionably true or false. And many that are 
do not measure the abstract and Inferential 
learning objectives that are part of a university 
course.. With a 50-50 chance of a correct guess 
for each question a test needs a large number of 
Items then a multiple-choice test to ma I nt a I n 1 1 s 
discriminating power. True-false tests, while 
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appealing to those with little experience of test 
construction, should be used with great caution, 

( d ) Multiple-Choice Tests ; 

We I I constru cte d mu 1 1 1 p I e-chol ce tests are capable 
of measu r I ng most educat 1 ona I objectives, vfhether 
the ability to solve problems, recommend actions and 
make predictions, or the acquisition of knowledge, 
unders tending, andjudgement. In view of a notun- 
common vie'w that objective tests require only a 
superficial knowledge of simple facts some more 
details on multiple-choice tests may be helpful. 

20. The major drawback of objective tests Is that bad Items 
.are so simple to construct. Both questions and answers 
must avoid clues which assist the uninformed student to 
answer correctly without really understanding the 
material. It Is Important to make sure that correct and 
incorrect answers are of the same length, structure, 
technical sophistication and grammatical form or else 
they wl I I stick out as Incongruous. For example there 
Is little merit In an Item such as: 

” Freu d was a - I . Ma r I ne b I o I 6g I st 

2. Psychoanalyst 

3. Ethologist 

4. Historian” 

Similarly a question such as ”what Is the best form of 
treatment for anelderly pat I ent w 1 1 h thy rot ox I cos I s and 
se ve re hea rt f a I I u re?” poses the problem as to whether 
the treatment Is really for the hea rt fa I 1 U re or the 
thyrotoxicosis. The^uestlon, asaprefacetoamultiple- 
cholce Item, might read better as ”what I s the best form 
of treatment for t h v rotox I cos I s In ah elderly patient 



appealing to those with little experience of test 
construction, should be used with great caution. 

( d ) Multiple-Choice Tests ; 

Well constructed multiple-choice tests are capable 
of measuring most educational objectives, whether 
the ability to solve problems, recommend actions and 
make predictions, or the acquisition of knowledge, 
understanding, and Judgement. in view of a not un- 
common view that objective tests require only a 
superficial knowledge of simple facts some more 
details on multiple-choice tests may be helpful. 



The major drawback of objective tests Is that bad Items 
are so simple to construct. Both questions and answers 
must avoid clues which assist the uninformed student to 
answer correctly without really understanding the 
material. It Is Important to make sure that correct and 
Incorrect answers are of the same length, structure, 
technical sophistication and grammatical form or else 
they will stick out as Incongruous. For example there 
Is little merit In an Item such as; 



"Freud was a 



1 . Marine biologist 

2 . Psy choa na I yst 

3. Ethologist 

4 . HI stor I an" 



SIml larly a question such as "what Is the best form of 
treatment for an elderly patient with thyrotoxicosis and 
severe heart failure?" poses the problem as to whether 
the treatment Is really for the hea rt failure or the 
thyrotoxicosis. The question, as a preface to a multiple- 
choice Item, might read better as "what Is the best form 
of treatment for thyrotoxicosis In an e I de r I y pat I ent 
with heart failure?" The response alternatives may then 
coni'aln elements relating to the treatment of both 
disorders. Some multiple-choice Items may simply test 
knowledge, some may test ability to argue logically, and 
1 terns like the following can do both : 

"Assume that over a ten-year period consumer purchases had 
dropped from 75 per cent to 65 per cent of the GNP, and 
that Investment and net exports had remal ned the same, 
proportionately. On the basis of this Information alone, 
we can be certain that: 

1. Total expenditure had declined, percentage-w I se 

2. The size of the GNP had declined 

3. Government spending had Increased, percentage-wise 

4. The size of d I sposab I e I ncome had declined 

5. Personal savings had I n creased , percentage- w I se . 

The correct answer Is (3). 

A careful examiner may; having devised a multiple- 
choice test that tests factual recall, data Interpre- 
tation, and problem solution, then pretest the 
examlhation oh all of hi s departments I colleagues to 
check for ambiguities and errors and to establish some 
sort of standard. In particular, the examiner should 
attempt to ensure that some of the questions are clearly 
(j I sc r i m I natory so that the better s'*‘udents are able to be 
distinguished from the du 1 I or Once a lecturer 

has set an objective test h® results, 

and must do so con s I ste nt I y . ,JThu s for a nine-part 
question with three correct answers an examiner could; 

I. award points for each correct answer 
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2 . award pot nt.s for- each correct answer and deduct 

poi n + s for ©ach wrong answer — • . ^ 

3. award points for each correct answer I dent I f t ed and 

fncorrect answer which has'b^en 
idenTlfled as Incorreci’. 

Th f IS last approach for a nine-part question can give a 
score range of 19 whe re three r I ght answers g I ve p | u s 3 
six wrong answers Ignored rg We plus 6» ending up with * 

^ ift^i In the opposite way one can score minus 9. The 
multiple-choice approac may then, provide the scope for 
a wide spread of marks, ahd, I f used with computer marking 
can save much staff time aftefr examInatIons>> ^ 

It may be argued that the above account of objective tests 
Is too opt Imist Ic .1 n tone and I n su f f I c I e n1 I y attentive to 
problems^ of test construction for staff and problems of 
examination stress when suO are used frequenti y. 

Further, uni verslty staff rn fNew Zea land may be ;On ly too 

c® If i.'l’l;*® PPO'" test cons trii cti on I n some Schoo I 

Ce rt I f I cate papers us I ng th I s app roac h . ' 1 1 -may we I I be 

J" ® "V . re se rvatlon s fe It by ; s taf f , pa rt I cu la r ly I n the 
- “ t t h® s 6c la I science s, stem f rom the i r per- 
V;. ’ °"S vrat Inherent In 

^ to 

Jy St- 1 TV staff r^^ Ions may be as sop hi s-h leafed as they 

® ■ do-we 1 1 to assess the bas I s 

of : whatever d.oubts they have . 



Use of the Year * s W6 r k" 



2. award po1 n+.s for each corrocl" answer and dedu ct 
points for each wrong answer 

3. award points for each correct answer Identified and 
av/ard points for each Incorrect answer which has been 
Identified as Incorrect. 

This last approach for a nine-part question can give a 
score range of 19 where three right answers give plus 3, 
six wrong answers Ignored give plus 6, ending up with 
plus 9. In the opposite way one can score minus 9. The 
multiple-choice approach may then, provide the scope for 
a wide spread of marks, and. If used with computer marking, 
can save much staff time after examinations. 

22. It may be argued that the above account of objective tests 
Is too optimistic In tone and Insufficiently attentive to 
problems of test construction for staff and problems of 
examination stress when such tests are used frequently. 
Further, university staff I n New Zealand may be Only too 
wel I aware of the poor test construction In some School 
Certificate papers using this approach. It may well be 
that many re se rvat l on s f e I t by staff, particularly In the 
humanities and the social sciences, stem from their per- 
sonal limitations rather than from problems Inherent In 
objective testing. The rat Iona I I sat Ions that emerge to 
Justify staff reservations may be as sophisticated as they 
are fanciful and staff cou Id do well to assessthebasis 
of whatever doubts they have. 

Use of the Year’s Work 

23. A second approach to the p rob I em of 1 mp rov I ng the trad- 
itional examination system Is to ”use the year's work in 
the final assessmeht," This approach may: bypass the 
debate about assessment procedures and s I mp I y dea I w I th 
the des I ra b I I I ty of grading students by counting final 
examinations as worth say 75 per cent of the final- marks 
while the year's work Is graded out of 25 per cent. A 
number of New Zea I and u n I ve rs 1 1 1 es have emphasised that 
this approach Is f o I lowed by a number of departments In 
their Institution. The varieties of assessment procedu^res 
and the differences In the proportioning of marks between'^ 
finals and the year's work makes "use of the year's work" 

a convenient but quest I on-begg I ng approach to the whole 
problem of Improving assessment procedures. For, wh I le 
It Is of Interest to note that departments either do, or 
plan to, a I I oca te ma rks for the year's work they may well 
do so by varying the l r a sses smerit p roced u res not one whit. 
For example, a department that a I locates 30 per cent of 
the marks for the f I na I g ra do on the basis of a tradition- 
ally styled examination set In the second term, and 70 
per cent on the bas I s of a f I na I exam In at Ion could only 
marg I, na j ly be said to con s I de r the year's work. Similarly 
a Oepa rtmeh t that a 1 1 oeated 25 pe r cent of the f 1 na I 
marks for tests, essay s a n d p ract I ca I exam I nat .1 ons; th rough- 
ou t the yea r ! s st I I I re ly I ng large I y on f 1 na I examinations 
for the final gradings. . , 

24. Where New Zealand university departments have Introduced 
a 25/75 per cent distinction between"the year's work" 
and f inal exam 1 nat I ons they have, f requent ly aserlbed to 
their procedures the merits and detrierl assessment 

systems that use no examinations but only the norma I 
assignment work. Academic's can argue' that such an 
allocation promotes more steady work, a better coverage 
of the year's work. Improved academic standards, and a 
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reduction of the element of chance. On the other hand, 
those who wish the year's- work to be free from assessment, 
can argue that even a, say 25/75 per cent division, re- 
creates an undesirable p re-u n I ve rs I ty learning situation. 
Increases demands on staff time. Increases the chance of 
plagiarism, penalises those who work best under concen- 
trated pressure, and limits the freedom of students to 
plan their own work.. Some academics for whom examinations 
are the essence of assessment, env I sage t he g r I m specta- 
cle of a steeplechase system of examinations. It could. 

It would seem be fairly argued that the "use of the year’s 
work" does not, necessarily, but very we I I cou I d , enta I I 
an Improvement on the trad It I ona I examination system. In 
this context the "could" Is contingent on staff flexibility 

Essay Exam I nat I ons 

Essay exam I nat I Ohs have been the standard fare for univer- 
s I ty students for a long time, and -many of the criticisms 
of traditional exami n 1 ng: re I ate pa rt I cu I a r I y t o the limit- 
ations of subject I ve marki ng that are a f eatu re of most 
essay exami nations. It Is, In fact, the difficulties In 
scor I ng , rat he r than the form of questions or their purpose 
that have been most used to pinpoint weakness In the 
essay sty I e exam I nat 1 on . At the same time there are two 
general schools of thought about the relevance of the 
form of essay exams . One sc hog I a rgues that the essay- 
type quest I c.-i tests abl llty to write discursively and 



reduction of the element of chance. On the other hand, 
those who wish the year’s- work to be free from assessmenr, 
can argue that even a, say 25/75 per cent division, re- 
creates an undesirable p re-u n 1 vers 1 ty learning situation. 
Increases demands on staff time. Increases the chance of 
plagiarism, penalises those who work best under concen- 
+ ra+©d prossur©^ and I Icni+s +h© fr©©doin of s+udanTS to 
plan their own work. Some academics for whom exam 1 nat 1 ons 
are the essence of assessment, envisage the grim specta- 
cl© of a st©epl©chase system of examinations. It could. 

It would seem be fairly argued that the "use of the year s 
work” does not, necessarily, but very well could, ental 
an Improvement on the traditional examination system. n 
this context the ’’could” Is contingent on staff flexibility. 
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Essay Examinations 

Essay examinations have been the standard fare for univer- 
sity students for a long time, and many of the criticisms 
of traditional examining relate particularly to the limit- 
ations of subjective marking that are a feature of most 
essay examinations. It Is, In fact, the difficulties In 
scoring, rather than the form of questions or their purpose, 
that have been most used to pinpoint weakness In the 
essay style examination. At the same time there are two 
general schools of thought about the relevance of the 
form of essay exams. One school argues that the essay- 
type question tests ability to write discursively and 
lucidly and shows whether or not a candidate can synthesise 
and genera I Ise. The other school suggests that the usual 
examination, with three to five questions to be discussed 
In three hours, tests a very specialised kind of ability, 
and puts a premium on speed and superficiality. It 
limits the student to one mode of exp ress 1 on , a nd often , 
so the argument Conti nues, provides a more sensitive 
measu re‘ of wr 1 t I ng speed and resistance to anxiety than 
educational achievement. It should be noted that 
merits proposed for the essay exam are also often attrib- 
uted to essays done under non-examination conditions, 
whereas the demerits noted by the second school above re- 
late sped f 1 ca II y to exainl nat 1 on conditions and do not 
contradict the merits attributed to non-exam I nat I on essays. 
Advocates of the essay examl hat l on do, of course, raise 
questions reading to the feasablllty of proper assessment 
of non-exami nat! on essays but such questions are generally^ 
capable of some answer. (See, for example, M 1 chae I Bassey 
As se s s me n t by Fo rm a I ' A s s I'g n me n t s , NZUSA,- I 97 I ) 

Potential troubles with essay examinations may, some sugg- 
est, be minimised if questions are geared at a reasonable 
level, are worded clearly and unambiguous I y, are specific 
on the scope and length ot answers required, and 
adequately sample 1 nstruct! onal object! ves. In marking, 
examiners could mark each paper without know 1 ng who _w rote 
it (often dlfflcult),'grade ail answers to one question 
at one sitting, randomize the sequence 1 n which scripts 
are read, and Judge each essay quest 1 on ana 1 ytl ca I I y by 
assignl ng points t° various sections. Whether these^ 
mechanical procedures provide any safeguards 1 a moot 

poiht they might however he l p to imp rove ess® Y 

at Ions. For examp le, an essay In answer to the question 
’’Describe the origins of World War I" Is both f^or® _ 
difficult to a n swe r p o 1 n ted I y" a-nd tO mark than^ Explain 
why each ot the great European powers - Austria, Germany, 
France and Great Britain - must bear some of the 
responsibirity tor the events which led immediately to the 
outbreak Of Wor id War 1: . ' On balance,- it might be said 



tha1" the essay appears capable of making a valuable con- 
tribution to student thinking and student capacity to 
arrange ideas, but a cumulative assessment of students’ 
essays over a period of time might well be more reliable 
than the results of essay examinations. ■ On no account, 
however. If essay examinations are to be set, should they 
be set at the end of a course In which students have written 
no essays at all. If essay writing is not relevant to 
achieving the course objectives then it has no place in 
assessing the extent to which these objectives have been 
reached. Conversely if an essay examination has to be set 
at the end of a given course then, since thrt course 
contains objectives best measured, in part at least, by 
essay work there should be essay work during the course it~ 
self. 

Practical Examinations — 

The assessment of practical skills or experimental ability 
Is an aspect of university teaching that ra re I y attracts 
the attention of educationists. If a university teacher 
looks for a single pu b I i cat I on to assist him In setting 
better problem papers, assessing experimental work, or 
evaluating practical skills more objectively, he will 
probably look In vain. Yet for many graduate scientists, 
and most dentists, doctors, horticulturists, engineers, 
architects, etc, the professional ski I Is are p ro b a b I y as 
Important as the theoretical base on which they are bu I 1 1, 
While ’’practical examinations” may not form part of each 
aspect of the sciences and professional disciplines, they 



i*hai" +h© essay appears capable of making a valuaDie con- 
trlbutlon to student thinking and student capacity to 
arrange Ideas, but a cumulative assessment of students 
essays over a period of time might well be more reliable 
than the results of essay examinations. On no account, 
however, if essay examinations are to be set, should they 
be set at the end of a course In which students have written 
no essays at all. If essay writing Is not relevant to 
achieving the course objectives then It has no place In 
assessing the extent to which these objectives have been 
reached. Conversely If an essay examination has to be set 
at the end of a given course then, since thrt course 
contains objectives best measured, in part at least, by 
essay work there should be essay work during the course It- 
self. 

Practical Examinations " 

27. The assessment of practical skills or experimental ability 
Is an aspect of university teaching that rarely attracts 
the attention of educationists. If a university teacher 
looks for a single publication to assist him In setting 
better problem papers, assessing experimental work, or 
evaluating practical skills more objectively, he will 
probably look In vain. Yet for many graduate scientists, 
and most dentists, doctors, horticulturists, engineers, 
architects, etc, the professional skills are probably as 
Important as the theoretical base on which they are built. 
While ’’practical examinations” may not form part of each- 
aspect of the sciences and professional disciplines, they 
are sti I I present I n one form or another I n many courses. 

In laboratories, workshops, drawing offices, studios, 
farms and hospitals university students are dissecting 
organisms, building machinery, designing buildings, per- 
forming on musical Instruments, assessing the merits of 
a new crop, and Interviewing disturbed patients. And, 
since these activities form part of the course and are 
undertaken presumably with some course objective In mind, 
+hey are righ+ly assessed. 

28. With such a wide range of practical skills Involved In 
university courses the following comments may have a 
bearing only on certain types of courses. For students 
with regular laboratory classes It might be argued that 
the objectives of practical classes are to teach the skill 
of experimentation, the value and Importance of care and 
precision I n expe r I me nta I research, the design of 
experiments and the scope and I imitations of the scten- 
tific method. Some academics might believe that students, 
through their own observations and measurements will see 
that the laws and theories they have met In their lectures 
can be. In part at least, confirmed In practice. The 
latter belief Is consistent with assessment procedures for 
practical work that are tests of verbal information and 
application. For the former objectives, however. It Is 
not at all obvious that linguistically coded Information 
produced under examination conditions can be sensibly 
used in assessing a student ’ s exposu re to the segment 
of experience to which such Information might refer. 

This point Is well taken by many university departments 
and the practical examination may then involve the 
student In the attempt to "do an experiment” (or 
experiments) under close o'aservatlon at a time and date 
specified for exam I nat I on purposes . 

This approach to the assessment of practical work, pai 
tlcularly where It Involves a "rerun” of one or more 
’’experiments” previously attempted as part of the course 

24 




may test manual dexte rt ty», +he ablfl+y +0 comm-untca+e , the 
extent to wh-1 ch -f ac+s and knowledge of procedure have been 
assimilated, and ability to write a report succinctly, but 
it provides little scope for assessing creative ability. 
Perhaps our practical classes do not Justify any other 
assessment procedures. If that Is so then lecturers may 
we 1 I have to ask themselves whether they wish to retain 
practical work for the purpose of Illustrating learned work 
or to enable students to sample scientific behaviour. If 
academics are concerned with the latter purpose then assess- 
ment procedures may change accordingly. For example. In 
most practical v/ork situations there would appear to be 
little or no reason why the assessment of practical work 
should not be done In the laboratory at the time when normal 
laboratory work Is being done. To set a 'practical 
examination' when continuous assessment is either being 
done (or Is possible) is to add unnecessarl ly to the course 
demands . 

For those concerned with the assessment of laboratory work 
It may help to consider the assessment of practical work In 
the context of a course In which the laboratory I s ,.used for 
more than the common activity of performing set tasks and 
writing reports accordingly. A description of such a course 
Is appended to this paper (Appendix I: The Efficient Use 

of Laboratory time In the Teaching of Engineering) and out- 
lines a programme of experimental work with ce rta I n spec 1 f 1 - 
ed objectives. University staff should consider whether 
or not the objectives mentioned are ones they agree with, 
whether these objectives are currently met in their own 
practical courses, whether the programme outlined Is 
consistent with their own thinking on experimental work, 
and whether or not such work can be assessed outside the 
normal laboratory setting. By posing such questions 
university teachers might find It difficult to avoid the 
conclusion that practical examinations are a poor substi- 
tute for assessment and that an enquiry oriented programme 
Is of more value than the replication of classical and 
standard experiments. 

Oral Examinations 

By long standing tradition oral examinations are most 
frequently used In medicine, dentistry, and foreign 
languages. Like traditional w r I tten exam I nat I on s they 
are reputed to provoke anxiety and to be severely limited 
In reliability and in the depth of evaluation which they 
provide. In d I scuss I ng the question of oral examinations 
the Victoria University Report of the Professorial Board 
Committee on Examining (March 1971, paras 57-61) as smarted 
that New Zea land university students are u n f am I I I ar" w 1 1 h 
the technique of "ora I expos 1 1 Ion . " The Committee 
suggested t hat t h I s u n f am I i I a r I ty constituted "another 
argument against theuse of oral examining." I t may 
very well be true that t he poss I b I I I ty of reliable and 
valid assessment by oral I nte rrogat Ion or even by 
discussion should be t reated scept I ca I I y . Nonetheless, 

If uhlversity teachers see skill In verbal communication 
as an objective of university teaching they may have some 
basis for an attempt to assess such skills. If such 
skills are foreign to New Zealand students perhaps they 
could be Introduced to them more systemat I ca I I y than at 
present. This Is not to say that oral exam I nat I on s m 1 ght 
be the ideal wayof assessing verbal skills - for It Is 
In the group 25 



discussion, +u + orIa! and labona+ory con + sx+ i"hat academic 
staff might best assess. However, where the examination 
context can be proved to be the best place for testing oral 
proficiency, some steps can be taken to marginally Improve 
test objectivity. First, the examiner or examiners could 
comp lie as specific a list as possible of the a re os of 
knowledge and skill they intend to evaluate. Secondly a 
permanent record cou I d - be obtained on audio or videotape so 
that the discussion can be examined at leisure. Thirdly, 
for clinical examinations In medical subjects the results* 
of oral examination could be checked against the record of 
student's performance In ward rounds, outpatients 
clinics, etc. 

Changes in Examination Conditions 

A number of small modifications to the traditional examin- 
ation procedures have been proposed from time to time, 
occasionally with arguments for and against the proposal 
Included, but rarely with details of the objectives that 
are likely to ur.dergird the proposals. First, some 
examiners have suggested open-book examinations In which 
students are free to take text and reference books Into an 
examination room. It is probable that most of the alleged 
merits of essay examinations would be retained equally as 
we I I if such a procedure were adopted. With poorly struc- 
tured questions this system might encourage the regurgi- 
tation of text book material but could equally easily be 
said to test ability In the use of reference materials. 
Secondjy, exam I ne rs cou I d provide students with specific 

sbout the examination questions at s reasonable 
time before the exam Itself. Advocates of this approach 
might argue that the resulting lack of need for "question 
spotting" or complete course coverage will enable students 
to reveal their abllitylito study In depth, and may reduce 
nervous tension a little. Certainly It Is doubtful that 
the provision of information would in any way alter student 
dependence on memory or writing skill. Those who may 
currently benefit from more Inspired question spotting 
would have no clear advantage, and those who do not trust 
their question spotting" ability would be relieved of the 
disadvantages of superficially scanning all their material 
be fore each examination. Thi rd ly, by setting a single- 
question unseen examination paper a student may be enabled 
to explore one topic In greater depth with an emphasis on 
synthesis of Ideas rather than on speed of 
writing. Most of advantages and disadvantages of the 
normal three hour paper are retained In this proposal 
except for the drawback of the superficiality Imposed bv 
shorter questions. 

Where a u n I vers I ty department Is unwilling to lose Its 
^pendence on formal examinations it might well consider 
t%€L_possl bi i ity of varying the type of exam I nat i on se t In 
line w^rh changes similar to those described In the 
preceeding paragraph, or by the use of "take-hone" 
examinations. At the same time it might we! I be of value 
to discuss whether or not there are any intrinsic merits 
in holding examinations of three hours duration. The 
Victoria University Report oh Examining already referred 
to, argues at some length In favour of one - or two-hour 
examinations (paras 35 and 36). The Report asserts, 
i-Q-t e r alia, that a one-hou r paper can adequ ate I y samp 1 e 



a large amount of presumed knowledge; that three-hour 
examinations confuse assessment with tenacity; that more 
frequent shorter examinations can valSdIy test as capably 
as one three hour final examination; and that more frequent 
shorter examinations could reduce the need for the "sterile 
regimentation" of "finals." Such claims If acceptable, 
could help justify a reduction In staff reliance on the 
end-of-year three-hour unseen exami nat ton . .. 
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Assessment procedures must. It can reasonably be argued, 
form a part of the total context of a university system. 
This assertion, though not without Its detractors, does 
suggest that changes In other aspects of a university 
might ental I the need for changes in assessment procedures 
and, conversely, changes In assessment procedures might 
entail changes In other aspects of a university. In 
this section of our study of assessment by formal examin- 
ations we shall I ook at the questions oft he value of 
grades, and all special' types of passes . 

Grading Students 

When the examination rooms empty out In mid-November and 
when the academic staff of our university h a ve a 1 1 ocated 
the marks to each examination script, undergraduate 
students rush for the newspapers to see whether they have 
been awarded an A, B or C pass or a D or E failure. For 
many students enrolled In ’’Intermediate" courses these 
grades are the basis onwhichthey wlll bea c cep ted o r 
rejected for e n ro I me nt I n a p rof e ss I ona I school. And, 
fot students completing a Masters or Honours degree the 
"FI r s t Cl a s s Ho n ou r s" label may be t he admission tic ket 
to an academic career or a post-graduate scholarship. 

While the attack on grad I ng has not yet reached New Zealanc 
universities to a n y s I g n I f I ca n t deg ree I t m I g h t be of 
Interest to note the k I nd of a rg ume nt s proposed by the 
advocates of grade abolition overseas. 
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Assessment procedures must. It can reasonably be argued, 
form a part of the total context of a university system. 
This assertion, though not without its detractors, does 
suggest that changes In other aspects of a university 
might entail the need for changes in assessment procedures 
and, conversely, changes In assessment procedures might 
entail changes in other aspects of a university, 
this section of our study of assessment by formal 
atlons we shall look at the questions of the 
grades, and all special- typos of passes. 
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35 , Grading Students 

When the examination rooms empty out In mid-November and 
when the academic staff of our university have allocated 
the marks to each examination script, undergraduate 
students rush for the newspapers to see whether they have 
been awarded an B or C pass or a D or E failure. For 
many students enrol led In ’’Intermediate” courses these 
grades are the basis on which they will be ac ce p t e d or 
rejected for enrolment In a professional school . And, 
for students completing a Masters or Honours degree the 
’’Firs'f Class Honours” label may be the admission ticket 
to an academic career or a pos-f-g ra d uate scholarship. 

While the attack on grading has not yet reached New Zealand 
universities to any significant degree It might be of 
Interest to note the kind of arguments proposed by the 
advoca+es of grade abol I+Ion overseas. 



A+ +he ou + se1“ +hose who seek 1“o abo! fsh grades rnlgh1“ argue. 
In a variety of ways, that there are no valid and reliable 
-fe sts of academic ability. S ome basis forth is point of 

view can be Inferred from the known fact that the perfor- 
mances on standard I .Q. and achievement 
groups of people of non— European origin 
lower than for those of European origin 



the 

tests of many 
are consistently 
The argument 



culture I I y 



wou I d 



goes on to assert that If such tests were 
unbiassed the scores of distinguishable racial groups 
would be less varied. In the New Zealand context It 
be argued that Maori under-representation at university 
level might be countered by staging a fundamental attack 
on the whole academic assumption of basing rewards on 
culturally — biased tests of ability. A second prong of an 
attack on grades could derive from the suggestion that 
academic ability as at present tested Is only one of a 
number of abilities that should be valued by society, 
qualities of leadership needed by those who administer 
lead organisations, are not qualities that are readl ly 
related to the results of current assessment procedures, yet 
they are Important qualities needed by the kinds of people 
that universities should be producing. This aspect of 
the argument against grades finds considerable backing In 
the results of studies which examine the relationship 
b©tv/een university grades and adult achlevetisent. One 
major review study (I) I oo ke d at forty— six different 
studies dealing with career categories, such as business, 
teach Ing, engineering, medicine andsclentlficresearch 
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and 
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(!) Donald P. Hoyt ’’The relationship between college 
grades and adult achievement: a review of the 

literature,” American College Testing Program, 
Research Reports No. T, September I 965. 
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and concluded +ha+ 

”al+hough +hls area of research Is plagued by many 
+ heore+ I ca I , expe r I me n + a I , me a s u reme n+ , and s1a1*!s- 
+lcal d I f f I cu I + I e s , presen+ evidence s+rongly sugges+s 
+ ha+ college grades bear I I ++ I e or no re I a+ I onsh I p +o 
any measure of adult accomplishment." 

Such a conclusion, hitting so deeply as It does at the 
very basis of university staff recruitment patterns, will 
doubtless strike few chords of sympathy among academics 
themselves. For, to those who have achieved their own 
positions by demonstrating their academic ability, and 
who accept without question that such ability can or should 
be a fair basis for reward distribution, the arguments 
against grades pose personally disturbing questions. 

Those who, willingly or reluctantly, endorse the grading 
of students may we I I accept some of the views expressed 
by their opponents. They may agree that grading Is 
neither accurate nor uniform, that It does not really 
standardize academic achievement criteria, that It 
produces undue competitive strain, that It protects bad 
teaching, or that ’t fal Is to present an accurate model 
of' "real life." They may agree that grades frequently 
have a low correlation with creative achievement and that 
a motivation to earn a high grade Is not Identical to a 
motivation to learn. At the same time, they could well 
argue that academic standards, however incapable of 
clear definition, must be maintained because human beings 
are not capable of accepting a real life situation where 
all rewards become meaningless because they are distributed 
at random. Some cut-off point must be used to enable 
people to be sure, for example, that their doctor Is not 
simply an undeserving recipient of automatic certification. 

At this point the advocates of grade abol Itlon might re- 
enter the argument by suggesting that they seek a more 
moderate reform - the I nt roduct I on of pass/fall grading. 

Wh I le this proposal does not cover the problem of how to 
determine the pass/fail line It does entail the view that, 
for those who do pass, the existence of grades of passes 
Is, In some way. Irrelevant to the assessment of students. 
For example, whi le the broad categories of competent/ 
Incompetent might be Justified there are no sound reasons 
forassuming that a student four C passes Is superior to 
a student with three C passes and a D fal lure. Siml larly 
a studentwith B,C,D,D gradings In f our subjects might 
be superior to a student with AAEE gradings even though 
both have two passes and the latter student has the 
better passes. Whether argumentation of this type 
should preval I ove r content Ions that gra dedevaluation 
Is a necessary concommitant of good teaching Is a question 
that we shall. In this paper, bypass. Academics might 
we I I ask themselves, however, v/hy i'hey a I locate grades 
to students, how the y e stab I I sh their sfandards, v/hat 
distinghlses a poor B grade for a good C grade, and 
whether grading In any way Improves the quality of student 
learning. 



Reslrtcted and Aegro1~a1~ Passes 



There are a number of devices +ha+ can be In+roduced I n+o 
an examlna+lon sys+em +o ensure +ha+ s+uden+s are able +o 
have a fairer chance than If their sole prospects are 
through end-of-year examinations. None of these devices 
are necessarl ly relevant to a system of continuous 
assessment but can and have been used in New Zealand univer- 
sities In particular circumstances In conjunction with the 
normal examination system. In essence they Involve mod- 
ifications of examination results rather than changes In 
assessment procedures and are therefore mentioned In this 
paper only briefly and descriptively. 

A restricted pass may be given to a student whose examln- 
at I on resu Its make him a marginal failure. Such a pass 
could be credited towards the degree results but would not 
enable a student to enter the next stage of the subject. 

This approach would enable a department to formally recog- 
nise a reasonable performance by a student who was unlikely 
to successful ly complete a higher stage of study. With 
suitable limitations on the number of restricted passes 
allowable In any one degree some students might be able to 
complete their study more quickly. 

Supplementary Examinations have been held in some New 
Zealand universities for some time for students In a number 
of professional courses In which they must pass the year’s 
work as a whole to progress to a h I g he r - I eve I . In the 
general arts and science degrees such examination might 
enable some students to upgrade poor passes or to reduce 
the total time required for graduation by passing an 
examination which has previously been failed. In fairness 
It should be said that those New Zealand universities 
that have considered running supplementary examinations In 
some general degree subjects have raised plausible object- 
ions - that costs would be too high, staff research could 
suffer, students In full time vacation work might not be 
able to adequately prepare for "specials," and that where 
the year's work Is already being considered there Is no 
need for supplementary examinations. However, whi le there 
may be I I tt I e purpose served by an extension of the current 
form of written supplementary examinations held In late 
January as an examination rerun there could be Justification 
for supplementary oral examinations. Notwithstanding the 
limitations of o ra I exam I n I ng they may be used to supplement 
written examinations by enabi I ng a marginal candidate to 
elaborate on I nsu f f I cl e nt an swe r s , to show he has an 
adequate knowledge of the course It has answered too few 
questions to explain an unusual discrepancy In the 
standard, of his answers, to correct what appears to be an 
accidental error, or to develop a promising argument. 
Supplementary oral examinations with these alms could be 
usedwith marginal stu dents for the purposes attributed 
to written supplementary examinations. In the Victoria 
University Report already referred to, oral examinations 
were In fact discussed under the heading "reconsideration 
of scripts" (paras 56-61). That report rightly cites 
research evidence on the unreliability of oral examining 
but fallsto point out that the bulk of the evidence 
aval I able relates to research which contrasts written 
with oral examinations rather than written examinations 
with written examinations supplemented by oral examinations 
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for marginal candfda+es. While, then, oral examinations 
alone are of doubtful value one cannot conclude that thev 
would ne ce ssarlly be of little value In a supplementary 
rather than dominant position. An examiner cou Id, In 
going over a script with a candidate. Invite him to write 
a paragraph or two If he Is experiencing difficulty In 
oral formulation. This approach could diminish the 
problem of the alleged u n f am I I I a r I ty of New Zealand students 
with oral exposition. It would seem. In fact, that 
objections to oral examinations for marginal candidates 
derive more from Intuition than from evidence. Their 
greatest demonstrable drawback is. In fact, the Imposition 
of more re spon s I b I I I ty on the examiner. 

Cone I u s I on 

Formal exam I na 1 1 on ‘5 remain the mainstay of much assessment 
In the university. They are defended vigorously by some 
staff members, possibly those who have re I led most 
heavily on them over a period of years and have not ventured 
Into ot!ier assessment techniques. The comments In this 
paper may well seem to such academici, to be a threat to 
cherished traditions. To other academics, particularly 
those with an Interest In, and u nderstand I ng of, the wealth 
of experience of those whose experimentation goes far beyond 
the conservative confines of this paper, my analysis and 
comments may seem quite archaic. Hopefully, those at 
both extremes may have found some comments of relevance 
and Interest, For, If ’’continuous assessment” In some 
form or other Is not yet acceptable to our university 
teachers, they may st I I I be able to attempt minor and 
conservative reforms of the type hinted at In this paper. 
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The Efffcfent Use of Laboratory Time In the 
Teaching of Engineering 



Mr D.E.P. Jenkins. 



iraditlonally I abora tory expe r Iments are used as a means of 
supplementing the lecture and the tu tor I a I , a nd expe r I men t s are 
performed In order to verify certain aspects of t he t heo ry , I f 
the student attends the laboratory regularly and writes labora- 
tory reports of the req u I re d sta n da rd , then this Is often 
considered to be efficient use of laboratory time. 

The difficulty arises If one wants to dev I ate from th I s pattern. 
Indeed, one has to make a p os 1 1 1 ve e f f o rt eve n to think about a 
change In the pattern, and when one has reac he d t h I s stag e It 
becomes necessa ry to ask some quest I ons . F I rst I y , why I s the 

change necessary? Secon d I y , what changes are to be made? WM I 

the change be an Improvement, a nd wh at benef I ts w I I I t he 
student enjoy from any changes that are made? 

It Is Interesting to look quIcKly at the wel 1— knpv/n pattam of a 
great deal of laboratory work In science an d e ng I nee r I ng . The 
student works from a laboratory sheet on wh Ich .the main aspects 
of t he expe r I me n t S-. -a re outl-'Ined, a n d? he Is expected to carry out 
work according to t he gene ra I d I recti on s of the sheet s‘ an d draw 
I b I e cone I us I ons f rom h I s resu Its. This Is an a I I too 
ERIC* * * ® *" pattern of wh I ch most of us have experience. The main 
gggg^ggf IcIsm, | feol. of thIs system lsthat ltdoes not e n cou rage, 
creative thinking. This has been recognised for a very long 
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Tr ad I + I ona I I y labora + ory experlmen + s are used as a means of 
su p p I erne n+ 1 ng +he lec + ure and +he +u + orIaI, and experlmen + s are 
performed In order +o verify cer+ain aspec+s of +he +heory. If 
+he s+uden+ a++ends +he labora+ory regularly and wri+es labora- 
+ory repor+s of +he required s+andard, +heii +hls Is of + en 
considered +o be e+flclen+ use of labora+ory + I me . 

The difficul+y arises If one wan+s +o devla+e from +h I s pa++ern. 
Indeed, one has +o make a posi+Ive effor+ even +o +hlnk abou+ a 
change In +he pa++ern, and when one has reached +hls s+age 1+ 
becomes necessary +o ask some ques+Ions. FIrs+ly, why Is +he 

change necessary? Secondly, wha+ changes are +o be made? WIN 
+ he change be an Improvemen + , and wha+ benef I+s wl I I +he 
s+uden+ enjoy from any changes +ha+ are made? 

1+ Is In+eres+Ing +o look quickly a+ +he well-knov^n pa+ + ern of a 
grea+ deal of labora+ory work In science and engineering. The 
s+uden+ works from a labora+ory shee+ on which +he main aspec+s 
of +he experlmen+s are ou+i I ned , and he Is expec+ed +o carry ou+ 
work according +o +he general direc+lons of +he shee+s and draw 
sens Ible conclusions f rom his resul+s. This Is an all +oo 
familiar pa+ + ern of which mos+ of us have expe rience. The main 
cri+icism, I feel, of +h I s sys+em Is +ha+ 1+ does no+ encourage 
crea+Ive +hlnking. This has been recognised for a very long 
+ 1 me and some a++emp + s have been made In engineering +o overcome 
+he problem, no+a b I y by +he In+roduc+lon of simple projec+s. In 
+he early years of +he course. Al+hough +h I s Is a useful +ool 
1+ does no+ In my view provide an en+Irely sa+Isfac+ory solu+Ion 
+he whole problem Is much more fundamen+al, as +he only 
sa+Isfac + ory way of deal Ing wl+h la bo ra + ory work Is +o + rea + I + 
as an I n+eg ra I par+ of +he course, of equal Impor+ance +o +he 
lec+ure and +he +u+orIal. 

Supposing one +akes +he following s+andpotn+: (a) one has +hree 

or four years +o Impar+ Informa+Ion +o +he s+uden+; (b) +he 
Informa+Ion +o be conveyed Is de+ermlned by +he syl labus; (c) 

In order +o enable +he lec+urers +o under+ake +he +ask +he 
universl+y provides +he foil ow Ing +ool s : I ec + u r I ng f ac I I I + I e s , 

+u+orial faclll+les, library faclll+les and labora+ory facll- 
1+ I e s . 

The nex+ s+age In +he analysis Is +o look a+ +he subjec+ as a 
whole and de+ermlne which par+s of +he course are bes+ done 
by lec+ure, which by +u+orIals or discussions, which by priva+e 
read Ing and searching In +he library, and which In +he I aboi — 
a+ory . This Is a very dlfflcul+ +ask and Is one which In my 
experience many lec+urers are no+ ^prepared +o under+ake. 

Having analysed +he course as a whole and de+ermlned +he +opIcs 
which are bes+ +augh+ by expe r I men+a 1 Techniques, we are In a 
posl+lon +o ask how we should use +he experlmen+al +echnlques 
I n re la + Ion +o +he selec + ed +oplcs, and w ha + la + en+ ablll + I es 
In +he s+uden+ we wish +o develop In +he +Ime devo+ed +o +he 
experlmen+al +echnlques. We shou I d a++emp+ +o se+ down some 
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+ i! °^J®ct1ves of a scheme of laboratory work. For example, 

+ Llf I should promote a true spirit of Inquiry and ordered 
hinking, provide maximum student Involvement and hence mottva- 
t on, demand the active participation of all students In both 
planning and performing experimental work, encourage students to 
cr Icise and accept criticism, provide an environment where the 
maximum level and standard of work is limited only by the 
students ability, enthusiasm and the time available, develop In 
the case of engineering a sound basis for tackling real 
engineering situations. In particular concepts of engineering 
compromise, provide a forum for general discussion and teach 
the correct use of library facilities and other reference 



All this you have doubtless heard many times before and It mav' 
sounid rather hackneyed, but If you accept these as being realis- 
tic alms of any teaching situation and as the basis of planning 
a programme of experimental work you are Immediately faced with 
a very challenging problem. I am now In a position to describe 
how we have faced this challenge In the Electrical Eng?nelr?^g 
Departn.ent cf the City University, both at the first Sear anS^ 
Third year levels of a four year course. 

^ ^ look at the work at first year level. Each week 

If^tvne^®h^+ two fifty-mlnute lectures of the conventlon- 

confined to selected topics, mainly fundamental; 

+ h^ io"+ ’^^9® gfoiJP tutorlc.,' of about thirty students, when all 
Ind iroM^r® concerned with the work are prLent f or d I scu ss Ion 

engineer no hours allocated to experimental 

^ non-lecturing aspects are called. For the 

u"se'by°t'hri?uJen?s:'°“" available for 
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hi ^*^® ‘^®9'"';'fng of the term the student Is presented with a 
Sueft'lInS®"®!? several sheets of carefully prepared 

very difficult'^ apparently very simple to the 

+^rm InJ f I*. T^®*^® ®f® +WO more such handouts during the 

grouierfn ?hf. I ^® ®+®d to broad areas of work, convenIen?Ty 
2It«nSl+i particular subject to direct current theory. ^ 

ThI studin? ®“f»-®nt theory and electro-magnetic field theory, 
he Is ahio ' s expected to answer as many of these questions as 
he Is able, using the tools at his disposal. Some of the 

by reference to the theory, others can 
h?Ise^f so'^®d by carrying out experimental work. Thrstldent 
himself must decide how to tackle the problems. 1 f hi decides 
to carry out an experiment he must first of all design It th#>n 

ThI^ansIe?s^to'aTT"the'^^^^'^t?“^ work and produce the results, 

ine answers to all the questions, theoretical and oractlcal a no 

'".^,l='>°--atory log book. In this wa^he buTldJ u; I 
complete picture of Information on the particular subject of ?he 

f^^iilar;ork^'’anS wrltten-u% report on ^ijrLper-'’® 

efJnnt ! °S 5°°'" teoord of the student's 

+ * j.T^ ^ ^ corrected by the I e ctu re r- tu tor with a view 

'^®'P "''® s+urif^nt to understand the 
subject and recognise his own deficiencies. naersxand the 



Let us now think for a moment about the supervision which 
associated with this kind of project. Four lecturers as 
are responsible for the first-year i n s t ru ct I on of a s?u dint in 
this particular subject. The Intake at the moment Is about 
sixty or seventy and, as you may know. In our particular 
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yeir^oni°rn''?«n+" ? sandwFch system which has two entries per 
Sepi-ombor and one fn February, both of which are 

+ • Each of the lecturers, therefore acts 

as a tutor to about fifteen or eighteen student^. ' 

The students work I n groups of three for the experimental 
engineering periods, three such groups per lecturer heinn Tn +k 
laboratory during any one three-hour period. Approximately ^ 

tht‘"i!XrTrn’VS:- ^uast.Sns j s^tHTPod^cid by 

nea?bv +be students are taken to'^a 

ChTch aMsI !rem''?he = hort d j scu ss I ons on rmportant Issues 

wnicn arise from the experimental work. In this wav +ho 

8u^::ib^^;t^%e%%s^:°:o?:r„i":ra"r,;:dr;;,^ '= 

Jlra'HfultiftVv^^T^ ^n;.?:?7bynpi=:^io^s?r:?r^nr 

SHOU, :i=k\':LY°:dlS¥!ren;-ass;^taliX :Tt^''i"d^ a^dlaL^lin: 

ERJCary,''so°that the s^ul!i'^+''® ’*'2 ^ 1 and a departmental 

MMMf p studies. ^ SvUdents use the laboratory as a base for 



Ins+I+u + lon we run a sandwich sys+em which has i"wo sn + rles per 
year, one In Sep+©mbor and one In February, bo+h of which are 
a bou + s I x+y or seven + y. Each of +he lec+urers, +herefore, ac + s 
as a tutor to about fifteen or eighteen students. 

The students work In groups of three for the experimental 
engineering periods, three such groups per lecturer being In the 
laboratory during any one three-hour period. Approximately 
six weeks are devoted to each set of questions, the laboratory 
being available on alternate weeks at set times, but the students 
a re pe rm Itted to use It' at any ot her time provided the re I s 
adequate supervision. Each set of questions Is Introduced by 
the lecturer In a discussion period, and siml larly summarised and 
discussed in another period. The lecturer tutor Is aval lable 
In the laboratory for the whole of the three hours, and normal ly 
deals only with his own group of students. In practice It Is 
a continuous process of discussion, questions and answers, with 
on the spot demonstrations of difficult topics and analyses of 
Incorrect procedures. Often the students are taken to a 
nearby tutorial room for short discussions on Important Issues 
which arise from the experimental work. In this way the 
lecturer gets to know his students very we I I , and he Is able to 
guide the students, working on an Individual basis. 

The pattern of three students per group using the ! atory on 

alternate weeks Is determined entirely by space con. orations 
and availability of equipment. Ideally we think the student 
should work Independently and associated with and adjacent to 
the laboratory there should be tutorial rooms and a depai fmenta I 
library, so that the students use the laboratory as a base for 
their studies. 

In the third-year work, where at the moment the numbers are 
sma I ler because the s I xty /seventy Intake has not yet reached 
the third year, the approach has proceeded one stage further. 

Hepe the laboratory Is actual ly used as a basis for teaching 
the subjects. In this case networks and power systems. The 
lecture Is used only to explain fundamental concepts. The 
experiments In the laboratory are designed to Involve the student 
in the use of these fundamental concepts and engineering 
practice and give him the opportunity to exercise his powers of 
critical thinking. Carefully constructed numerical and 
theoretical examples are given to the students and these are 
dealt with In the tutorial pe r I od s-cum-d I scu ss I on groups of 
about six students with the lecturers present. Each student 
Is g I ven the respons Iblllty for solving and understanding one 
example In each tutorial period. He has to provide his 
solution and explanation to his fellow students, and the 
lecturers who are present, by means of a short lecture/talk/ 
demonstration. The essence of this approach is again a very 
close relationship between the lecturers and the students, and 
also the use of the laboratory as a teaching tool and a base 
for stu dy . 

Let us now consider for a moment or tv/O' student/ staff reaction 
to these schemes. In particular In the first-year work. The 
Immediate reaction of the student Is that this approach is 
elementary and Is a little beneath him. This Is natu ra I sin ce 
-f-lie equipment they u se Is usually very simple and 't' he exper- 
imental techniques unglamorous, and It Is Important to bear In 
mind that these students from good grammar schools will In 
their Upper VI physics work often have used very sophisticated 
equipment. This attitude soon changes to one of Interest and 
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I a+e r Immense en+huslasm. In our experience. This Inevl+ably 
leads +o a comparison wi+h the laboratory work they carry out 
In other departments on more traditional lines, and there Is no 
doubt In our view they see the value of the new approach wc- are 
using. The log book entries are variable; the good students 
usua I ly produce very good work but the others have to be 
encouraged. Student participation Is the striking feature of 
this work. They learn from one another and develop their 
ablMty to ask questions. 

Now the lecturer reaction: this Is extremely hard work and the 

laboratory sessions often become three hours of concentration 
and discussion and explanation — much more difficult than 
supervising set tasks In the laboratory. The preparation of 
the question sheets Is probably the most difficult part of the 
whole exercise. They have to be carefully constructed and 
amended in the light of experience. The analysis and 
criticism of the log book has to be done thoroughly and con- 
scientiously and discussed with the student If he Is to learn 
from his mistakes. 

In conclusion I would like to bring your thoughts to Just four 
more points which In my view are most important. I would first 
of all like to echo Professor Tyrrell’s comments and say that 
material presented In the early years of the work must be 
relevant and must be seen by the students to be relevant. This 
is very Important. Secondly, a student who has been educated 
In a system such as I have described, a system based on an 
experimental approach to learning, has been trained to analyse, 
ask questions and generally use his powers of creativity and 
critical thinking. He will feel severely let down If In his 
next years of the subject he reverts to traditional laboratory 
techniques. This Is a very serious problem Indeed, since the 

second and third years of the course become Increasingly 
difficult to deal with in this way. The final year Is easier, 
since It Is then possible to use the advanced project as a 
means of stimulating the student. These comments are, of 
course, also applicable to students moving Into university life 
from the grammar school, particularly those students who are now 
coming up who have been taught on the Nuffield science project 
method, because the technique Is exactly the same and this 
transfer becomes exactly the same. 

Thirdly, In my experience lecturers are .very conservative and 
resist change. A scheme such as the one I have outlined can 
meet with a great deal of opposition. Initially It must be 
carried through by one or two enthusiasts who by, their 
demonstration of enthusiasm will win others in support of their 
ideas. Lastly, the student usual ly hes no choice In the 
matter; he has to participate In tho new schemes. Nevertheless, 
he must feel confident that his education will not suffer as 
a result of his participation In Innovations. As educators we 
have a dual responsibility: one, we must make advances In 

teaching methods, but, two, we must also ensure an adequate 
education for the students In our charge. 
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